Papers with text generation methods
Enhancing Multi-Document Summarization with Cross-Document Graph-based Information Extraction (2023.eacl-main)
Copied to clipboard
| Challenge: | Information extraction (IE) and summarization (summarization) are closely related, but both aims to abstract the most salient information into a generated text summary. |
| Approach: | They propose to use structured IE graphs to enhance the abstractive summarization task by using cross-document IE output to incorporate an alignment loss between IE nodes and their text spans to reduce inconsistencies. |
| Outcome: | The proposed model can generate summaries that are more factual while not losing abstractiveness. |
Pun Generation with Surprise (N19-1)
Copied to clipboard
| Challenge: | In this paper, we explore creative generation with a focus on puns. |
| Approach: | They propose an unsupervised approach to generating puns using lots of raw text and a surprisal principle. |
| Outcome: | The proposed approach generates puns 30% of the time, doubles the neural generation baseline. |
Diversity-Promoting GAN: A Cross-Entropy Based Generative Adversarial Network for Diversified Text Generation (D18-1)
Copied to clipboard
| Challenge: | Existing text generation methods tend to produce repeated and ”boring” expressions. |
| Approach: | They propose a model that assigns low reward for repeatedly generated text and high reward for ”novel” and fluent text, and a novel language-model based discriminator which can distinguish novel text from repeated text without the saturation problem. |
| Outcome: | The proposed model generates more diverse and informative text than existing baselines on review generation and dialogue generation tasks. |
Asking the Crowd: Question Analysis, Evaluation and Generation for Open Discussion on Online Forums (P19-1)
Copied to clipboard
| Challenge: | Existing work on teaching machines to ask questions focused on generating fixed answers. |
| Approach: | They propose a model to generate open-answered questions from real-world news for open discussion . they analyze how language use affects the number of answers . |
| Outcome: | The proposed model generates questions with higher quality than most text generation methods. |
TinyStyler: Efficient Few-Shot Text Style Transfer with Authorship Embeddings (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for text style transfer rely on few-shot capabilities of large language models or complex controllable text generation approaches that are inefficient and underperform on fluency metrics. |
| Approach: | They propose a lightweight but effective approach which leverages a small language model and pre-trained authorship embeddings to perform efficient, few-shot text style transfer. |
| Outcome: | The proposed method outperforms strong approaches such as GPT-4 and performs form attribute style transfer with automatic and human evaluations. |